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A portion of the disclosure of this patent document contains material that is subject 
to copyright protection. The copyright owner has no objection to the facsimile 
5 reproduction by anyone of the patent document or the patent disclosure, as it appears in the 
Patent and Trademark Office patent file or records, but otherwise reserves all copyright 
rights whatsoever. 



BACKGROUND 
10 1. FIELD 

The present invention relates generally to decoding of variable-length prefix 
codes, e.g., Huffman codes, and, more specifically, to a new, combined decoding scheme 
of lookup table decoding and prefix oriented decoding. 
2. DESCRIPTION 

15 Entropy coding is a widely used data compression technique that many video and 

audio coding standards are based on. The theoretical basis of entropy coding states that a 
compression effect can be reached when the most frequently used data are coded with a 
fewer number of bits than the number of bits denoting the less frequently appearing data. 
This approach results in coded data streams composed of codes having different lengths. 

20 There are a number of methods to form such variable length codes (VLC). One 

popular method uses a prefixed coding in which a code consists of a prefix that allows a 
decoding system to distinguish between different codes, and several significant bits 
representing a particular value (e.g., Huffman coding). 

While most coding standards employ Huffman codes with prefixes composed of a 

25 series of T or k 0 5 bits in their coding schemes, some standards (e.g., ISO/IEC 14496-2, 
Moving Pictures Experts Group (MPEG)-4 coding standard, Visual) allow for different 
coding schemes prefixed with a series of longer bit patterns. 

As a general rule, the number of bits that comprise a variable length code depends 
on the number of bits that comprise the prefix of the code. At the same time, an 

30 experimentally defined subset of most frequently appearing codes may have relatively 
short prefixes (including zero prefix) and, thus, may be decoded in a lookup manner as a 
single code, which may be a faster way of decoding for a particular system. 
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Therefore, a need exists for the capability to provide high speed decoding of 
variable length codes prefixed with regular combinations of bits, in accordance with the 
actual frequency-to-code length distribution. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

The features and advantages of the present invention will become apparent from the 
following detailed description of the present invention in which: 

Figure 1 is a diagram illustrating an exemplary variable length coding; 
Figure 2 is a diagram illustrating relations between bits initially read from a bit 
10 stream, selected bits, and a table containing a decoded value, a validity indicator and 
auxiliary information; and 

Figure 3 is a flow diagram illustrating the variable length decoding process in 
accordance with an embodiment of the present invention. 

15 DETAILED DESCRIPTION 

An embodiment of the present invention is a method of implementing a decoder for 
variable length codes that have prefixes composed of regular bit patterns. To apply the 
disclosed method to a particular coding scheme, such a scheme should comprise a subset 
of most frequently used codes with relatively short prefixes (including zero prefix), such 

20 that the prefix scan operation becomes inefficient. According to the disclosed method, the 
number of bits, not less than the maximal possible length of a VLC, is read from a bit 
stream. Then a predetermined number of bits is selected and used as an index to a data 
structure that contains at least a decoded value and validity indicator, along with other pre- 
decoded data, including but not limited to: prefix type and length, maximal code length for 

25 a group of codes, actual code length, and the number of bits to return to the bit stream. The 
validity indicator is used to determine whether to proceed with the decoding operation, or 
obtain the valid decoded value from the data structure and return excess bits to the bit 
stream. If the decoded value is indicated to be invalid, the decoding operation is continued, 
and a decoding method that estimates the length of the code prefix and the number of 

30 significant bits corresponding to the length estimated is applied to the bits initially read 
from the bit stream. The disclosed method requires less memory than direct lookup 
decoding methods, and performance of the method exhibits less memory access overhead 
as compared to prior art methods using multiple lookup tables. Additionally, the present 
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method appears to be more efficient for decoding of 'short prefix' codes as compared to 
other prefix oriented methods because it excludes operations of prefix type and length 
determination for the most frequently used codes. 

Reference in the specification to "one embodiment" or "an embodiment" of the 
5 present invention means that a particular feature, structure or characteristic described in 
connection with the embodiment is included in at least one embodiment of the present 
invention. Thus, the appearances of the phrase "in one embodiment" appearing in various 
places throughout the specification are not necessarily all referring to the same 
embodiment. 

10 Figure 1 is a diagram illustrating an exemplary variable length coding. As depicted 

by Figure 1, each variable length code has a group of bits used as a prefix 10 and a group 
of significant bits 12. The prefixes may be composed of a group of bits (bit patterns) that 
(in a general case) are replicated and concatenated to each other. The bits that follow the 
code prefix may be called significant bits. 

15 Variable length codes (VLCs) may have identical prefixes. In this case, the codes 

constitute a prefix code group, but at the same time the number of significant bits that 
follow the prefix may differ. The maximal number of significant bits that is possible for a 
code in such a group may be referred to as the maximal bit number. The number of bits 
that follow the prefix for each VLC may be called the actual bit number. 

20 Figure 2 is a diagram illustrating relations between bits initially read from a bit 

stream, selected bits, and a table containing a decoded value, a validity indicator and 
auxiliary information in accordance with an embodiment of the present invention. As 
depicted in the example of Figure 2, the number of bits 20 not less than any possible VLC 
length, i.e., the number of bits enough to contain the longest VLC in a particular coding 

25 scheme, may be read from a bit stream. Any number of leading bits 22 may be selected 
from the bits read. A data structure 24 is provided to contain at least decoded data and a 
validity indicator for each bit combination that may be formed from the selected bits. The 
data structure 24 may also contain auxiliary information on the type of prefix, code length, 
and the number of bits to return to the bit stream, in order to facilitate future decoding. 

30 Figure 3 is a flow diagram illustrating a variable length decoding process in 

accordance with an embodiment of the present invention. At block 100, the number of bits 
not less than any possible variable length code is read from a bit stream. The number of 
bits read should be sufficient to contain the longest variable length code but is not limited 
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to store extra bits as it may facilitate the decoding process (e.g., the bits read fit the machine 
word size). Then, at block 102, the predetermined number of bits may be selected from the 
bits previously read. The number of bits to select depends on a particular coding scheme 
used, and, therefore, is determined by external means. The determination should be 
5 performed in a manner that allows the selected bits to span the most frequently used (the 
most probable) YLCs and at the same time tq/minimize the size of a code lookup table. At 
block 104 the code lookup table is indexed with the value formed from the selected bits, and 
at least a decoded value and a validity indicator, as well as auxiliary information are 
obtained. In one embodiment, obtaining the auxiliary information may be optional. The 

10 validity indicator is then checked at block 106, and if it is indicated to be valid, the decoded 
value obtained at block 104 is returned as the result of the decoding process at block 108. If 
necessary, the actual code length or the difference between the actual length and the number 
of selected bits (retrieved as auxiliary information at block 104) may be checked in order to 
adjust the bit stream after decoding. 

15 If the decoded data is indicated to be invalid, a prefix oriented decoding method (i.e., 

a method that estimates the length of the code prefix and the number of significant bits 
corresponding to the length estimated) is applied at block 110 to the bits initially read from 
the bit stream. The auxiliary information obtained at block 104 may describe the type and 
length of the code prefix, and thus, increase the performance of the method to be further 

20 applied. 

For an exemplary embodiment of the present invention implemented in the C and 
Assembler programming languages, refer to Appendix A. This example is non-limiting and 
one skilled in the art may implement the present invention in other programming languages 
without departing from the scope of the claimed invention. 

25 The techniques described herein are not limited to any particular hardware or 

software configuration; they may find applicability in any computing or processing 
environment. The techniques may be implemented in logic embodied in hardware, software, 
or firmware components, or a combination of the above. The techniques may be 
implemented in programs executing on programmable machines such as mobile or 

30 stationary computers, personal digital assistants, set top boxes, cellular telephones and 
pagers, and other electronic devices, that each include a processor, a storage medium 
readable by the processor (including volatile and non-volatile memory and/or storage 
elements), at least one input device, and one or more output devices. Program code is 
applied to the data entered using the input device to perform the functions described and to 
3AMEH5HOXIJHfi JIHCT (HPABHJIO 26) 
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generate output information. The output information may be applied to one or more output 
devices. One of ordinary skill in the art may appreciate that the invention can be practiced 
with various computer system configurations, including multiprocessor systems, 
minicomputers, mainframe computers, and the like. The invention can also be practiced in 
5 distributed computing environments where tasks may be performed by remote processing 
devices that are linked through a communications network. 

Each program may be implemented in a high level procedural or object oriented 
programming language to communicate with a processing system. However, programs 
may be implemented in assembly or machine language, if desired. In any case, the 

1 0 language may be compiled or interpreted. 

Program instructions may be used to cause a general-purpose or special-purpose 
processing system that is programmed with the instructions to perform the operations 
described herein. Alternatively, the operations may be performed by specific hardware 
components that contain hardwired logic for performing the operations, or by any 

15 combination of programmed computer components and custom hardware components. 
The methods described herein may be provided as a computer program product that may 
include a machine readable medium having stored thereon instructions that may be used to 
program a processing system or other electronic device to perform the methods. The term 
"machine readable medium" used herein shall include any medium that is capable of 

20 storing or encoding a sequence of instructions for execution by the machine and that cause 
the machine to perform any one of the methods described herein. The term "machine 
readable medium" shall accordingly include, but not be limited to, solid-state memories, 
optical and magnetic disks, and a carrier wave that encodes a data signal. Furthermore, it 
is common in the art to speak of software, in one form or another (e.g., program, 

25 procedure, process, application, module, logic, and so on) as taking an action or causing a 
result. Such expressions are merely a shorthand way of stating the execution of the 
software by a processing system cause the processor to perform an action or produce a 
result. 

While this invention has been described with reference to illustrative embodiments, 
30 this description is not intended to be construed in a limiting sense. Various modifications 
of the illustrative embodiments, as well as other embodiments of the invention, which are 
apparent to persons skilled in the art to which the invention pertains are deemed to lie 
within the spirit and scope of the invention. 
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© 2002 Intel Corporation 
GetVLC function (Assembler) 
5 InitTable function ("C") 

Input table ("C") and initial Huffinan table (text) 
Bit stream structure ("C") 

Initial Huffman code table 
10 



Codes Vector differences 



15 



20 
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0 


010 


1 


011 


-1 


0010 


2 
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-2 
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00001010 
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6 
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-6 


00000110 


7 


00000111 
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0000010110 


8 


0000010111 
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0000010100 
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0000010010 


10 
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*/ 



25 Packed code/value table containing 

information on prefix length and 
significant bit number 



/// the table elements should be sorted by prefix length 

30 

static const long exTableJVGxed[] = 

{ 

13, /* max bits | bit-size flag */ 
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7, /* number of prefix groups */ 
5, /* lookup table length (in bits) */ 

1, /* code length */ 
1, /* size of group */ 
0, /* bit index*/ 
0, /* get bits*/ 
0, /* unget bits */ 
0x00010000, 

3, /* 3 -bit codes */ 
2, 

1, 
1, 
0, 

0x00020001, 0x0003fHf, 

4, /* 4-bit codes */ 
2, 

2, 
1, 
0, 

0x00020002, 0x0003fffe, 

5, /* 5-bit codes */ 
2, 

3, 
1, 
0, 

0x00020003, 0x0003 flffd, 
8, /* 8-bit codes */ 
4, 
4, 
3, 
0, 

0x00080006, 0x0009ffFa, 0x000a0005, OxOOObffib, 
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7, /* 7-bit codes */ 
2, 

4, 
3, 
1, 

0x00060004, 0x0007fffc, 
11,/* 11-bit codes */ 
4, 
5, 
5, 
0, 

0x0020000c, 0x0021flff4, 0x0022000b, 0x0023ffi5, 

10, /* 10-bit codes */ 
6, 

5, 
5, 
1, 

0x0012000a, 0x0013fiF6, 0x00140009, Ox0015flF7, 0x00160008, 0x0017flS8, 

8, /* 8-bit codes */ 
2, 

5, 
5, 
3, 

0x00060007, 0x0007ffi9, 

11, /* 11-bit codes */ 
16, 

6, 
4, 
0, 

0x00100014, 0x001 lffec, 0x00120013, 0x0013ffed, 0x00140012, 0x0015ffee, 
0x00160011, 0x0017ffe£ 0x00180010, Ox0019fflTO, OxOOlaOOOf, OxOOlbfiffl, 
OxOOlcOOOe, OxOOldffiQ, OxOOleOOOd, 0x001flH3, 
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-1 /* end of table */ 

}; 



Bit Stream structures 



typedef struct JVIplDataBuf 
{ 

unsigned char *data; 
long data Jen; 
long data__pffset; 
} MplDataBuf; 

typedef struct JVtplBitStream 
{ 

long bit__ptr; // Buffer bit pointer (3 1 -0) 

MplDataBuf *data_buf; // Pointer to data and its size 

unsigned long *start_data; // Internal bitsream pointers 
unsigned long *end_data; 
unsigned long *current_data; 

FILE *fd; // Input or output file 

jmpjDuf exit joint; // Exit point to handle incorrect vie codes 
} MplBitStream; 



#define DATA_BUFFER_SIZE 1 * 1024* 1024 

unsigned long bit_mask[33] - 
{ 
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0x00000000, 

0x00000001, 0x00000003, 0x00000007, OxOOOOOOOf, 
OxOOOOOOlf, 0x0000003f, 0x0000007f, OxOOOOOOff, 
0x00000 lfif, 0x000003flF, 0x000007ff, OxOOOOOffF, 
0x0000 lfflf, 0x00003 fiF, 0x00007ffF, OxOOOOffff, 
OxOOOlffff, Ox0003flfflf, 0x0007fHf, OxOOOfrEff, 
OxOOlfffff, Ox003ffrff, 0x007ffiEf, OxOOfffiff, 
OxOlfHHF, 0x03ffffH; 0x07fffiBff, OxOffHEff, 
OxlfiBEHff, Ox3ffiffiF, 0x7ffHHF, OxffflBBBF 

}; 



Function to form internal VLC table 



typedef unsigned long VLCDecodeTable; 

static VLCDecodeTable* CreateVLCDecodeTable_Mrxed(const long *src_table, 
VLCDecodeTable *table, long *table_size, long cyr_size) 
{ 

int vm4_vlc_code__mask, vm4_vlc_datajrnask, vm4 vlc_shift; 
int offset; 
int i, j; 

int code_Jength; 
int group_size; 
int bitjndex; 
int getjrits; 
int unget_bits; 
int group_count; 
int outidx; 
int group_offset; 
int lookup Jength; 
int prefix_offset; 
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switch(*srcJable-H- & VM4_VLCJLENJFLAG) 
{ 

case VM4__VLC_20: 

vm4_vlc__code_mask = OxfHHOOO; 

vm4_vlc_data_mask = OxOOQOOfiff; 

vm4_vlc__shift =12; 

break; 
case VM4_VLC_24: 

vm4_vlc_code_mask = O xflHHD O; 

vm4_vlc_data_mask = OxOOOOOOff; 

vm4_vlc_shift = 8; 

break; 
default: 

vm4_vlc_co dejnask = OxffifOOOO; 
vm4_vlc_data_mask = OxOOOOffif; 
vm4_vlc_shift = 16; 
break; 

} 

offset = *srcjable++ * 2; 
lookup_length = *src_table-H-; 
prefix_offset = (1 « lookup Jength) * 2 + 2; 
offset += prefix_offset; 

memset(table, 0, offset * sizeof(VLCDecodeTable)); 
///memset(table, -1, prefix_pffset * sizeof(VLCDecodeTable»; 

table[0] = 32 - lookup Jength; /// the bit count to shift right 
table[ 1] = prefix_offset; 

while(*srcjable != -1) 
{ 

code Jength = *srcjable++; 
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group_size = *src_table-H-; 

bit_index = *srcjable++ * 2 + prefix_offset; 

get_bits = *srcjable++; 

unget_bits = *src_table++; 

5 

if(!table[bit_index]) 
{ 

table[bit Jndex] = get_bits; 
table[bit_index + 1] = group_pfFset = offset; 

10 } 

for(i = 0, group_count = 0; i < group_size; i++) 

{ 

if(codeJength < lookupjength) 
15 { 

for(j = 0; j < (1 « (lookupjength - codejength)); j++) 
{ 

outidx = ((((((unsigned long int)(*src_table & vm4_vlc_code_mask)) 
» vm4_vlc_shift) & bitjtnask[code_length]) 
20 « (lookupjength - codejength)) + j) * 2; 

table[outidx + 2] = /^lookup Jength - */codeJength; 
table[outidx + 2 + 1] = ((*srcjable & vm4_vlc_data_mask) « (32 - 
vm4_vlc_shift)) » (32 - vm4_vlc_shift); 

25 } 
} 

else if(code Jength = lookupjength) 

{ 

outidx = ((((unsigned long int)(*srcjable & vm4_vlc_code_mask)) 
30 » vm4_vlc_shift) & bit_mask[code Jength]) * 2; 

table[outidx + 2] = codejength;///0; 

table[outidx + 2 + 1] = ((*srcjable & vm4_vlc_data_mask) « (32 - 
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vm4_vlc_shift)) » (32 - vm4_vlc_shift); 



} 



if(!unget_bits) 
5 { 

outidx = ((((unsigned long int)(*src_table & vm4_vlc_codejtnask)) 
» vm4_ylc_shift) & bit_mask[get_bits]) * 2; 

table[group_offset + outidx] = ((*srcjable & vm4_vlc_data_mask) « 
10 (32 - vm4_vlc_shift)) » (32 - 

vm4_vlc_shift); 
table[group_offset + outidx + 1] = 0; 
group__count++; 
src__table++; 

15 } 

else 

{ 

forQ = 0; j < (1 « unget_bits); j++) 
{ 

20 outidx = ((((((unsigned long int)(*src_table & vm4_vlc_code_mask)) 

» vm4_vlc_shift) & bit_mask[get_bits - unget_bits]) 
«unget_bits)+j) * 2; 

table[group__offset + outidx] = ((*srcj;able & vm4_vlc_data_mask) 
25 « (32 - vm4_vic_shift)) » (32 - 

vm4_vlc_shift); 
table[group_offset + outidx + 1] = unget_bits; 
group_count-H-; 

} 

30 src_table++; 
} 

} 

offset += group_count * 2; 
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*table_size = offset; 

5 return (VLCDecodeTable*)table; 

} 



10 



15 



Function to decode VLC (Assembler) 

.686 
xmm 

xmmword textequ <qword> 
mmword textequ <qword> 
.model FLAT 



20 



MplDataBuf struc 4t 

data dd ? 

data_len dd ? 

data_offset dd ? 

MplDataBuf ends 



25 



MplBitStream struc 4t 

bit _ptr dd ? ;;; Buffer bit pointer (3 1-0) 



data buf dd ? ;;: Pointer to data and its size 



30 



start_data dd ? 
end__data dd ? 
current data dd ? 



;;; Internal bitsream pointers 



fd 



dd 



Input or output file 
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exit__point dd ? Exit point to handle incorrect vie codes 

MplBitStream ends 



TEXT 



segment 



extrn _longjmp:near 



10 



;;; unsigned long asmbsGetVLCJ^ookupBit Search 

;;; (MplBitStream *bsm, const VLCDecodeTable *vlcTable) 



15 



20 



25 



30 



_asmbsGetVLC_LookupBitSearch proc near 

sizeofjocals equ 14h 

ws equ esp + 04h 

bsm equ dword ptr [eax + 04h] 

table equ dword ptr [eax + 08h] 

mov eax, esp 

sub esp, sizeofjocals 

and esp,0fffiffi0h 

push eax 

mov [ws],esi 

mov [ws + 04h],edi 

mov [ws + 08h],ecx 

mov [ws + 0ch],ebx 

mov [ws+10h],ebp 

mov esi,bsm 

mov editable 

mov ecx, lfh 

sub ecx,MplBitStream.bit_ptr[esi] 

mov ebx,MplBitStream. current_data[esi] 
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mov eax, [ebx] 
mo v edx, [ebx + 4] 
shld eax, edx, cl 



17 



;;; eax = data 



test 
jz 



eax, eax 
error code 



;;; this branch is supposed not to be taken 



10 



15 



;;; look up several bits first 

mov ecx,[edi] 

mov edx, eax 

shr edx,cl 

mov ebp,[edi + edx * 8 + 8] 

or ebp,ebp 

jz scan 

mov eax,[edi + edx * 8 + Och] 

mov ebx,MplBitStream.bit_ptr[esi] 

sub ebx,ebp 

js negative_ptr ;;; not taken 



ecx = 32 - lookup_bits 

;;; ebp — (un)get bits 

;;; not taken 
;;; eax = decoded data 



20 



25 



exit 

mov MplBitStream.bit_ptr[esi],ebx 

mov esi,[ws] 

mov edi,[ws + 04h] 

mov ecx,[ws + 08h] 

mov ebx,[ws + Och] 

mov ebp,[ws+ lOh] 

mov esp,[esp] 

ret 



30 



scan: 



bsr ecx,eax 



;;; ecx = index 



mov ebx,[edi + 4] 



;;; ebx = prefix__offset 
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add ebx,62 
mov ebp,3 1 



sub 
sub 
sub 



ebx,ecx 
ebx,ecx 
ebp,ecx 



ebx = offset (of bit index group) 
ebp = (31- index) 
mov edx,[edi + ebx * 4] edx = get_bits 

mov ebx,[edi + ebx * 4 + 4];;; ebx = offset (of code value and unget bits) 



10 



sub ecx,edx 
shr eax,cl 

and eax,bit_mask[edx * 4] ;;; eax = data 



15 



lea ebx, [ebx * 4] 

lea ebx, [ebx + eax * 8] 

mov ecx,[edi + ebx + 4] ecx = unget_bits 

mov eax,[edi + ebx] ;;; eax = data 



20 



mov ebx,MplBitStream.bit_ptr[esi] 

lea edx, [edx + ebp + 1] 

add ebx,ecx 

sub ebx, edx 



js negative_ptr 



not taken 



25 



almost_exit: 

mov MpIB it Stream. bit_ptr[esi] , ebx 



30 



exit: 



mov esi,[ws] 

mov edi, [ws + 04h] 

mov ecx,[ws + 08h] 

mov ebx,[ws + Och] 

mov ebp,[ws+ lOh] 
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mov esp,[esp] 
ret 



negative_ptr: 

add ebx,20h 

add MpIBitStream. current_data[esi],04h 



jmp almost_exit 



taken 



10 



15 



error_code: 
push 
lea 
push 
call 



-1 

edx,MplBitStream. exit _point[esi] 
edx 

Jtongjmp 



;;; no return here 



int 



OOh 



_asmbsGetVLCJLookupBitSearch endp 



20 



TEXT 



DATA 



ends 



segment 



bit mask 



25 



30 



DATA 
end 



dd OOOOOOOOh 

dd 0000000 1 h, 00000003 h, 00000007h, OOOOOOOfh 

dd OOOOOOlfh, 0000003fh, 0000007fh, OOOOOOffh 

dd 00000 lffii, 000003ffh, 000007ffh, OOOOOfffh 

dd OOOOlffih, 00003ffih, OOOOTflBQi, OOOOffiEh 

dd OOOlfflffh, 0003fiffi£h, 0007ffih, OOOflHHh 

dd OOlffHfh, 003fffffh, 007fHKh, OOfiBBfh 

dd Olfffiffh, 03flffifh, 07flBHHh, OfflSHfh 

da liiiii I in, Jiiiiiiin, /niiiiin, uiiiiiiiin 
ends 



